I JTTT JTY PATENT APPLICATION TRANSMITTAL UNDER 37 C.F.RA1.53(b) 

_A|§ISTANT COMMISSIONER FOR PATENTS 
'§% PATENT APPLICATION 
~"$hington D.C. 20231 



Case Docket No.:P-081_ 



rnsmitted herewith for filing is the patent application of 
" ENTOR OR APPLICATION IDENTIFIER: Sung-Bae JUN 

METHOD OF DESCRIBING MULTIPLE LEVEL DIGEST SEGMENT INFORMATION SCHEME FOR 
3 MULTIMEDIA CONTENTS AND APPARATUS FOR GENERATING DIGEST STREAM FROM 
DESCRIBED MULTIPLE LEVEL DIGEST SEGMENT INFORMATION SCHEME AND METHOD 
Enclosed are; 



1. [X] 2A_ pages of specification, claims, abstract 

2. [X] _5 sheets of FORMAL drawing. 

3. [X] _2_ pages of newly executed Declaration & Power 

of Attorney (original). 

4. [X] Priority Claimed. 

5. [ ] Small Entity Statement. 

6. [ ] Information Disclosure Statement, Form PTO-1449 

and reference. 

10. [X] Authorization under 37 C.F.R. §1. 136(a)(3). 

11. [ 1 Other: 



7. [X] Assignment Papers fo r LG Electronics Inc. 

(cover sheet, assignment & assignment fee). 

8. [X] Certified copy o f Korean Patent Application ^ 

3015/1999. filed Tanuarv 30. 1999 

9. [X] Two (2) return postcards. 

[X] Stamp & Return with Courier. 
[X] Prepaid Postcard-Stamped Filing Date & 
Returned with Unofficial Serial Number. 



1 " CLMMS A.SriJ ID 1 


For 


" No. VikA 




No, Extra 


Rate 


Fee 1 


Total Claims 


21 


-20 


0 


X $18.00 


$18.00 1 


Indep. Claims 


4 


-3 


0 


X $78.00 


$78.00 


Multiple Depent 


lent Claims (If applicable) X $260.00 


$0.00 1 


BASIC FEE 


$690.00 1 


TOTAL FILING FEE 


$786.00 



i:J ] This is a Continuation-in-part (CIP) of prior application No: _ 



"""[ ] 
[X] 



_ filed _ 



[X] 



_. Incorporation By Reference-The 
entire disclosure of the prior application is considered as being part of the disclosure of the accompanying application 
nj and is hereby incorporated by reference therein. 

rfii [ ] Amend the specification by inserting before the first line the sentence: 

i -This application is a continuation-in-part of Application Serial No. filed .-- 

A check in the amount of $ 786.00 (Check # 82711 is attached. 

Please charge my Deposit Account No. 16-0607 in the amount of $_. A duplicate copy of this sheet is enclosed. 
The Commissioner is hereby authorized to charge payment of the following fees associated with this communication or 
credit any overpayment to Deposit Account No. 16-0607. A duplicate copy is enclosed. 
[X] Any additional filing fees required under 37 C.F.R. 1.16. 

The Commissioner is hereby authorized to charge payment of following fees during the pendency of this application or 
credit any overpayment to Deposit Account No. 16-0607. A duplicate copy of this sheet is enclosed. 
[X] Any patent application processing fees under 37 C.F.R. 1.17. 
[X] Any filing fees under 37 C.F.R. 1.16 for presentation of extra claims. 

FLESHNER&E 



Correspondence Address Below: 
P.O. Box 221200 
Chantilly, VA 20153-1200 
(703) 502-9440 dvk/.„ 
Date: January 28, 2000 




METHOD OF DESCRIBING MULTIPLE LEVEL DIGEST SEGMENT 
INFORMATION SCHEME FOR MULTIMEDIA CONTENTS AND APPARATUS 
FOR GENERATING DIGEST STREAM FROM DESCRIBED MULTIPLE LEVEL 
DIGEST SEGMENT INFORMATION SCHEME AND METHOD THEREOF. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a technique for describing a muitiple level 
digest segment information scheme for multimedia contents in a content-based 
data area of a multimedia stream and method for generating a digest 
streams(highlights) using the multiple level digest segment information scheme for 
the purpose of providing a multiple levels of digest streams for a multimedia 
stream. 

2. Description of the Prior Art 

A digest stream for a multimedia stream is provided for the purpose of 
enabling users to understand the overall story and the structure of a multimedia, 
content or to find and move to desired position fast. 

Multimedia server system such as a VOD(Video-on-Demand) server system, 
a broadcast system, a karaoke, etc., can provide digest streams(highlights) for 
multimedia contents (e.g., movie, drama, sports, etc.) to achieve above purposes. 

A digest stream(highlight) of a multimedia stream is constructed by 
arranging audio-visual segments, each of which is the essence of an original 



stream in the development of the story. Here, the segment is a sequence of 
continuous frames. Since the digest stream is a sub stream of the multimedia 
stream, the size of the digest stream is much smaller than that of the original 
stream. 

Therefore, a user who want to understand the overall structure and/or the 
story of a multimedia content prefers to access a digest stream rather than 
accessing the entire stream. The digest stream also can be used as a program 
guide for users who want to select a program from a multimedia database. 

There are two types of summarization method for multimedia contents. The 
one is providing key frames or key regions and the other is providing digest 
streams(highlights) which is constructed by gathering and arranging important 
segments of an original stream 

in the former method, since it is difficult for a user to understand the entire 
flow of the original stream and it is difficult to display too many key frames at a 
time, an additional operation such as a screen scrolling is required in order to 
understand the content of the stream only with the key frames, thereby causing an 
inconvenience. 

In the latter method, generally a content provider extracts a sub stream 
from the original stream, and stores it separately In this case, an additional 
storage for storing the digest stream is required. In addition, the content provider 
edits only a certain time amount of the digest stream and provides it to the user. 
Accordingly the user can access only a single level digest stream edited by the 
content provider. Therefore, users cannot obtain various digest streams of the 
desired length. Suppose that a content provider provides only a 10 minute 



highlight for a 2 hour video. Under that situation, users may want to access 5, 10, 
20 minute digest streams respectively, depending upon their situation, lathat case, 
a user who want 5 or 20 minute highlight for the given content can not browse the 
digest stream of their desire. Only 10 minute digest stream will be served 

5 regardless of the user's request. Therefore, in order to satisfy user's various needs, 
the content provider has to edit and store multiple levels of digest streams for one 
multimedia stream. In this case, a large amount of storage is required to store 
multiple versions of digest streams, and accordingly, there occurs difficulty in 
managing each of the digest stream. 

10 ■ 

SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention to provide a multiple 
levels digest streams, thereby dynamically coping with the level of user's need 
15 with respect to a digest stream. 

It is another object of the present invention to provide multiple levels of 
digest streams with small amount of storage. 

It is yet another object of the present invention to reduce the encoding time 
of a digest stream. 

20 To achieve the above objects, there is provided a method of describing 

information about multiple levels of digest streams for multimedia contents in 
accordance with an embodiment of the present invention which includes tha steps 
of: describing the level information of digest segments by multiple levels in the 
content-based data area of the multimedia content; describing the digest level 

25 information of each digest segment and the time range information in a digest 

3 



segment information structure; and describing muiti level digest segment 
information scheme with digest segment information structures. 

To achieve the above objects, there is provided a method of describing 
information about multiple levels of digest streams for multimedia contents in 

5 accordance with the second embodiment of the present invention which includes 
the steps of: describing the digest level information of digest segments to a digest 
level header by multiple levels in the content-based data area of a multimedia 
stream; describing the time range information of each digest segment in a digest 
segment information structure; and describing information about digest streams by 

10 arranging the digest segment information structures of the same digest level. ; 
describing muiti level digest segment information scheme with digest level headers 
each of which has a list of digest segment information structures. In order to 
achieve the above objects, there is provided a method of generating multiple 
levels of digest streams for multimedia contents in accordance with the present 

15 invention which includes the steps of: detecting the digest level and time range 
information of each digest segment information structures from the multiple level 
digest information scheme contained in the content-based data area of a 
multimedia stream; and, when a condition is queried by the user, generating a 
multiple level digest stream by arranging the digest segments with a priority of. 

20 more than a certain level conresponding to the condition in a time sequence. 

In addition, to achieve the above objects, there is provided an apparatus for 
generating multiple levels of digest streams for multimedia contents in accordance 
with the present invention which includes an user input unit; a digest stream level 
determining unit for determining a digest level of a digest stream corresponding to 

25 the condition queried by the user input unit and outputting the same, upon receipt 



of a multimedia stream signal; and a decoder for decoding the digest segments 
having the above digest level and outputting the same. 

Additional advantages, objects and features of the invention will become 
more apparent from the description which follows. 

BRIEF DESCRIPTION OF THE INVENTION. 

The present invention will become more fully understood from the detailed 
description given herein below and the accompanying drawings which are given 
by way of illustration only and thus are not limitative of the present invention, and 
wherein: 

Figure 1 shows an example of digest segments for a multimedia stream in 
accordance with an embodiment of the present invention; 

Figure 2 shows the construction of a multiple level digest segment 
information scheme of a multimedia stream in accordance with an embodiment of 
the present invention; 

Figure 3 shows the construction of a multiple level digest segment 
information scheme of a multimedia stream in accordance with another 
embodiment of the present invention; 

Figure 4 shows an example of multiple level digest streams constructed by 
the multiple level digest segment information scheme; 

Figure 5 is a graph showing the total running time of digest streams 
according to digest levels; 

Figure 6 is a schematic block diagram of an apparatus for generating 
multiple levels of digest streams for multimedia contents in accordance with an 



embodiment of the present invention; 

Figure 7 is a sciiematic block diagram of an apparatus for generating 
multiple levels of digest streams for multimedia contents in accordance with 
another embodiment of the present invention; 

5 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS. 

In a content-based data area of a multimedia stream, generally, an 
appearance of an audio-visual object, occurrence information of each event, state 

10 information of audio-visual objects, events, backgrounds, scene information, shot 
information, segment information, etc. are described on a time axis. According to 
the present invention, the data structure of a multiple level digest segment 
information scheme for providing multiple levels of digest streams is desci ibed in 
the content-based data area thereof. The multiple level digest segment information 

15 scheme is constructed by a plurality of multiple level digest segment information 
structures, each of which is a data structure for describing digest segment in which 
a time range information of the digest segment is described and also a digest level 
information can be described. Moreover, in some cases, data for representing the 
running time of a digest stream or the total running time of digest segments of 

20 each digest level can be additionally described. A digest stream is comprised of 
digest segments. An importance level associated with each digest segment is 
used as a digest level for generating multiple levels of digest streams dynamically 
In addition, each digest segment information structure has a time range 
information of time continuous data, and the time range information can be 

25 represented by the start point and end point or the start point and duration of the 

6 



digest segment. 

Meanwhile, a digest segment is different from a shot, a scene and the lil<e. 
Taking example by drama, generally, a digest stream is not constructed by 
connecting shots or scenes. Because the whole content can be analogized by 

5 browsing only parts of a shot or a scene in most cases, a digest stream is 
generally constructed by connecting some parts of shots or scenes. In a field such 
as sports, digest stream does not use entire shot or entire scene in order to 
construct a digest stream for the reason of the characteristics thereof. 

In some cases, the digest segment corresponds to a shot or a scene, but, in 

10 most cases, it does not necessarily correspond to any of them. Therefore, in the 
present invention, the multiple level digest segment information scheme for 
providing multiple levels of digest streams by assigning an importance level to 
each digest segment, rather than by assigning an importance level to a shot or a 
scene, is proposed. Here, the digest segment is defined as a sequence of 

15 continuous frames, which is a general idea of covering shots or segments. 

The construction of a digest stream in accordance with the present 
invention will now be described with reference to Figures 1 through 5. 

Figure 1 shows an example of digest segments for a multimedia stream, in 
accordance with an embodiment of the present invention. As illustrated in Figurel , 

20 the horizontal axis represents the time axis, and the vertical axis denotes the 
digest level axis. It is shown that an original stream, which is a multimedia stream, . 
is divided into a plurality of digest segments, which are divided into a plurality of 
digest levels. In the present invention, it is assumed that a first digest level '0' is 
the highest in priority and a n-th digest level 'n-1 ' is the lowest. 

25 Figure 2 shows the construction of a multiple level digest segment 

7 



information scheme of a multimedia stream in accordance with an embodiment of 
the present invention. A portion illustrated by a square is a digest segment 
information structure, and a number illustrated within the square is an ID of a 
digest segment information structure, which is stated only for the convenience of 

5 explanation. Digest segment structures can be sequentially arranged in a time 
sequence, each of which has its digest level and time range information(start point 
and end point or start point and duration). 

Figure 3 shows the construction of a multiple level digest segment 
information scheme for a multimedia stream different from that of Figure 2. Digest 

10 level headers(Lo, L,, L..^) are divided according to digest levels, and assuming 
that the number of digest levels is n, the number of digest level headers is n. For 
each digest level headerCU U, L,.,), digest segment information structures of 
the corresponding digest level are arranged. For convenience, the digest segment 
information structures can be arranged in a time sequence. For instance, a first 

15 digest level header(Lo) has digest segment information structures 5, 10, 30 and 
138 arranged therein, and a second digest segment information structures 12, 22, 
40, 50, 54, 70 and 88 arranged therein. In this manner, unlike the digest segment 
information structure in accordance with an embodiment of the present invention 
as shown in Figure 2, the digest segment information structure in accordance with 

20 another embodiment of the present invention as shown in Figure 3 has its time 
range information, and its digest level is described in its digest level header. 
Herein, information on the position of a first digest segment information structure 
among a plurality of digest segment information structures belonging to each 
digest level header may be needed. In this case, the information on the position 

25 can be contained in the digest level header or other area. Meanwhile, the 
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presentation as illustrated in Figure 2 and the presentation as illustrated in Figure 
3 are easily convertible to each other. 

The method of obtaining multiple levels of digest streams from a multiple 
level digest segment information scheme for a multimedia content thus described 
will be illustrated below. 

It is assumed that the number of digest levels for the original stream is n, 
and the number of digest segments for the original stream is m as described 
above. Sj denotes the j-th digest segment information structure, L(Sj) denotes the 
digest level of the digest segment information structure Sj, and denotes the 
digest stream whose digest level is i. The digest stream can be represented by a 
sequence of digest segment information structures, so that when a set of digest 
segments of the digest stream(Hi) is denoted by S(Hi), the set S(Hi) is defined as 
follow: 

S(Hi) = {Sj I L(Sj) = 0,1,2,. ...i, 0=0,1,2,. ..,m-1)} 

That is, each element of the set S(Hi) is a digest segment information 
structure whose digest level is less than or equal to i. Ail the digest segment 
information structures contained in the set S(Hi) can be sorted in a time sequence. 
According to the definition of the above set S{Hi), the digest stream whose digest 
levels is k+1 (Hk^i) includes the digest stream whose digest level is-k(Hk). 

Taking example by Figure 3, the first digest stream(Ho) is constructed by 
arranging digest segment information structures(S5, SiO, S30 and S138) of digest 
level '0' in a time sequence, and the second digest stream(Hi) is constructed by 
arranging the digest segment information structures{S5, SIO, S30 and S138) 
digest level '0' and digest segment information structures(S12, S22, S40, S50,., 
S54, S70 and S88) of digest level 'V in a time sequence. That is, the second 



digest stream(Hi) is constructed by arranging digest segment information 
structures(S5, S10, S12, S22, S30, S40, S50, S54, S70, S88 ana S138) in a time 
sequence. 

Figure 4 shows an example of multiple level digest streams constructed by 
the above-described method. 

Next, the running time of each digest stream can be obtained based on the 
time range information contained in each of the plurality of digest segment 
information structures, which will be described below. 

The total running time of the digest segment information structures 
belonging to a i-th digest level is the sum of the running time of each of digest 
segment information structures which belong to the i-th digest level. 

That is, the running time R(H,) of the digest stream, whose digest level is 
k{Hk) can be represented by the sum of the running time of digest information 
structures whose digest level is less than or equal to k, can be expressed as 
follow: 

R(H^= f^R(Li) 

i=0 

Where R{ Li) denotes the sum of the running time of each digest segment 
information structure whose digest level is i. 

Figure 5 is a graph showing the total running time of a digest streams 
according to digest levels. As illustrated therein, since the digest stream whose 
digest level is k+1(Hk+i) includes the digest stream whose digest level is k(Hk). the 
running time R{H^^^) of the digest stream(H,,i) is longer than or equal to the 

10 



running time R(Hk) of the digest stream(Hk). 

Next, the operation of providing a digest stream according to the query of 
the user will be described. 

Figure 6 is a schematic block diagram of an apparatus for generating 
multiple levels of digest streams for a multimedia content in accordance with an 
embodiment of the present invention. In the apparatus as illustrated in Figure 6, 
when a plurality of running times is displayed, one of which is queried by the user, 
a digest stream corresponding to the queried running time is provided. 

As illustrated in Figure 6, the apparatus in accordance with an embodiment 
of the present invention includes a digest stream level determining unit 1 for 
determining and outputting the level of a digest stream corresponding to the 
running time queried by the user, upon receipt of a multimedia stream signal; a 
user input unit 2 for outputting the running time queried by the user to the digest 
stream level determining unit 1 by the operation of the user; a decoder 3 for 
outputting digest segments having a digest level by decoding based on the digest 
level which is inputted from the digest stream level determining unit 1 , upon receipt 
of a multimedia stream signal; and a browsing/recording/editing unit 4 for 
sequentially browsing, recording, and editing the outputted digest segments. 

The operation of the apparatus in accordance with an embodiment of the 
present invention thus described will now be described. Meanwhile, the operation 
of browsing, recording and editing performed by the browsing/recording/editing 
unit 4 is carried out by a well-known technique of the conventional art, and 
accordingly a detailed description thereof is omitted. 

The digest stream level determining unit 1 includes a digest segment 
information scheme analyzing unit 11 and a digest stream information display unit 



12. A content provider or a media file supplies the digest stream level determining 
unit 1 with a stream signal, and the digest stream level determining unit 1 
determines a digest level of a user-selected digest stream. Herein, the multimedia 
stream signal includes a stream data and a content-based data for the stream, and 
the content-based data of the stream includes related multiple level digest 
segment information scheme. 

The multiple level digest segment information scheme analyzing unit 11 
computes the running time of each digest stream by analyzing the multiple level 
digest segment information scheme. The digest stream information display unit 12 
displays the running time by computed digest streams to the outside. 

When the user inputs a desired running time among the displayed running 
times, the running time is queried through the user input unit 2. The digest stream 
information display unit 12 determines a digest level of a digest stream 
corresponding to the queried running time, and outputs it to the decoder 3. The 
decoder 3 outputs digest segments with the digest level by decoding based on the 
digest level which is inputted from the digest stream level determining unit 1 , upon 
receipt of a multimedia stream signal. The outputted digest segments are 
sequentially browsed, recorded, and edited by the browsing/recording/editing unit 
4. 

Taking example by Figure 4, if the digest level queried by the user is "1", the 
decoder 3 outputs digest segments of digest level "0" or "1" from the multimedia 
stream signal by decoding. 

In this manner, only the digest level of a digest stream is inputted to the 
decoder 3, and the decoder 3 selects digest segments from the multimedia stream 
signal based on the digest level and outputs them to the 



browsing/recording/editing unit 4. 

Figure 7 is a schematic block diagram of an apparatus for generating 
multiple levels of digest stream for a multimedia content in accordance with 
another embodiment of the present invention. The apparatus as shown in Figure 7 
provides a digest stream with a running time most close to the running time 
queried by the user. As illustrated in Figure 7, the apparatus in accordance with 
another embodiment of the present invention includes a digest stream level 
determining unit 5, an user input unit 2, decoder 3, and a 
browsing/recording/editing unit 4. The digest stream level determining unit 5 
includes a digest segment information scheme analyzing unit 11 and a digest level 
determining unit 51. Herein, the digest segment information scheme analyzing unit 
11, decoder 3, and browsing/recording/editing unit 4 are identical with those 
iilustrated in Figure 6. 

When the user inputs a desired running time by the user input unit 2, the 
digest level determining unit 51 outputs the digest level of a digest stream with a 
running time most close to the running time inputted by the user. That is, the digest 
level determining unit 51 compares the running time queried by the user with the 
running time of a digest stream of each multiple level digest stream, selects a 
running time R(H,) which is most close to the queried running time, and outputs a 
digest level(k) of the digest stream with the selected running time R(H,) to the 
decoder 3. In Figure 5, the running time queried by the user is marked by a thick 
line. The running time corresponding to the digest level(k) is slightly longer than 
the queried running time, and the running time of a digest stream corresponding to 
a digest level(k-l) is slightly shorter than the queried running time. 

The decoder 3 receives the multimedia stream signal, and outputs digest 



segments of a digest level lower than k or k-1 , based on the digest level(k or k-1 ). 
The outputted digest segments are sequentially browsed, recorded and edited by 
the browsing/recording/editing unit 4. 

Meanwhile, the embodiments of the present invention described above, in 

5 detail, the user input unit 2 as illustrated in Figures 6 and 7 is described by taking 
an operation of querying a running time of a digest stream for example, for the 
convenience of explanation. However, the user can queries other conditions 
besides a running time, the user input unit 2 can receive the conditions from the 
user, and the apparatus in accordance with the present invention provides a digest 

10 stream according to various conditions inputted by the user, which will be 
described below. 

When the user inputs various conditions, for example, an occurrence of 
events, persons, backgrounds, objects, and some kinds of situation information, 
the digest stream level determining unit 5 constructs a digest stream based on the 
15 conditions, for example, occurrence of a events, appearance of persons, 
backgrounds, objects, and some kinds of situation information. The various 
conditions queried by the user are, for example, as follows: 

Digest "Titanic" movie to 10 minutes focusing on "Leonardo Dicaprio". 
Digest "Titanic" movie to 1 0 minutes focusing on sinking scene. 
20 Digest a music to 1 00 seconds focusing on piano. 

According to these queries from the user, the digest stream level 
determining unit 5 construct a digest stream based on a running time and various 
query conditions or filtering conditions. By lowering or raising the digest level of 
each digest segment, a digest stream is constructed. For instance, although a 
25 digest segment has a low digest level(with a digest level value close to n), the 



digest segment is considered as a digest segment with a little higher digest level 
for thereby constructing a digest stream if it corresponds to a query condition(e.g., 
"sinking scene"). Occurrence of events, appearance of persons, backgrounds, 
objects, and some kinds of situation information mentioned above are information 
generally contained in a content-based data area of a multimedia stream. 

IVleanwhile, there is a need for rapidly accessing only the running time 
information of a possible digest stream for the convenience of applications. For 
this purpose, a digest level running time information or a digest stream running 
time information can be added to a primary digest segment information scheme as 
shown in Figure 2 or Figure 3. Herein, the digest level running time information is 
information about the sum of the running times of digest segments of the same 
digest level is described according to digest levels, and the running time 
information of the digest stream is the running time information of a possible digest 
stream. 

Such running time information can be described using an extra data 
structure, for example, in the case of a multiple level digest segment information 
scheme as shown in Figure Z In the case of a multiple level digest segment 
information scheme as shown in Figure 3, the running time information can be 
described in each digest level header, or described using other data structure. 

The above-described digest level running time information or digest stream 
running time information can be used for a rapid running time computation and for 
a parity check for a damaged data. 

The parity check is possible by comparing the total running time of digest 
segments of the same digest level with the digest level running time of that digest 
level, and also by comparing the total running time of digest segments 



corresponding to a digest level lower than a particular digest level with the digest 
stream running time of that digest level. More specifically, if the total running time 
of the digest segments of the same digest level and the digest level running time 
of that digest level are equivalent each other, it is determined that there is no data 

5 damage, and if the two running times are different, it is determined that there is a 
data damage. In addition, the total running time of digest segments having a digest 
level lower than a particular digest level and the digest stream running time 
corresponding to that digest level are equivalent each other, it is determined that 
there is no data damage, and if the two running times are different, it is determined 

10 that there is a data damage. 

Meanwhile, in the case that only the information about a possible digest is 
queried by a digest stream browser, the corresponding information can be 
displayed by accessing only the digest level running time information or the digest 
stream running time information. In the case that the user determines a digest 

15 level from the information, a digest stream can be generated by accessing only 
the actual digest segment. 

In this way, the digest level running time information and digest stream 
running time information additionally described in the multiple level digest segment 
information can be utilized for a rapid digest stream information transmission and 

20 for a parity check for determining whether or not there is a data damage. 

As described above in detail, in the present invention, a multiple level digest 
segment information scheme is stored in the content-based segment information 
scheme of an original stream, and an importance level(i.e., digest level) of a digest 
level information, a time range information, etc. is given to a digest segment of the 

25 multiple level digest segment information scheme, whereby the amount of storage 

16 



for storing a digest stream is greatly decreased and it takes a very little time to 
encode each digest stream. 

Moreover, by dynamically generating a digest stream using a digest 
segment information scheme during an execution of an application, it is 

5 unnecessary to edit a digest stream and encode an actual data so as to prpvide a 
multiple level digest stream. Therefore, it is possible to dynamically provide a 
digest stream corresponding to the dynamically changing level of user's need for a 
digest stream while the amount of data is not increased largely. Also, a user can 
browse a digest stream of a desired level for a desired time by using a multiple 

10 level digest stream provided. 

In addition, although it is explained above that a digest stream of a 
multimedia stream is provided for an user in a multimedia server system, the user 
can also understand the overall story and/or the structure of a multimedia content 
andhe or she can find and move to desired position fast by accessing the digest 

15 stream when he or she has a CD(compact disc) for the content. 
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What is claimed is: 



1 . A method of describing a multiple level digest segment information 
scheme for multimedia contents in order to provide multiple levels of digest 
streams for each multimedia content with small amount of additional storage in 
accordance with an embodiment comprising the steps of: 

describing the level information of digest segments by multiple levels in the 
content-based data area of the multimedia stream; 

describing the digest level information and the time range information of 
each digest segment in a digest segment information structure; and 

describing digest segment information scheme with a set of digest segment 
information structures. 

2. The method of claim 1, wherein the time range information is the 
start point and end point of or the start point and duration of the digest segment. 

3. The method of claim 1, wherein a digest level running time 
information or a digest stream running time information is added to the digest 
segment information scheme, in which the digest level running time information is 
information about the sum of the running time of digest segment information 
structures of the same digest level is described according to digest levels, and the 
running time information of the digest stream is a running time information of a 
possible digest streams. 

4. A method of describing a multiple level digest segment information 
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scheme for multimedia contents in order to provide multiple levels of digest 
streams for each multimedia content with small amount of additional storage in 
accordance with an embodiment in accordance with a second embodiment of the 
present invention comprising the steps of: 
5 describing the digest level information of digest segments to digest level 

headers by multiple levels in the content-based data area of a multimedia stream; 

describing the time range information of the digest segments in a digest 
segment information structure; and 

describing a digest stream information scheme with a set of digest level 
10 headers, each of which has a set of digest segment information structures with the 
same digest level. 

5. The method of claim 4, wherein the time range information is the 
start point and end point or the start point and duration of the digest segment. 

15 

6. The method of claim 4, wherein a digest level running time 
information or a digest stream running time information is added to the digest 
segment information scheme, in which the digest level running time information is 
information about the sum of running time of digest segment information structures 

20 of the same digest level is described according to digest levels, and the running 
time information of the digest stream is a running time information of a possible 
digest streams. 

7. The method of claim 4, wherein the digest level headers can be 

25 arranged with the order of importance(level) in order to construct a digest stream 
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from muiti level digest segment information scheme fast. 



8. The method of claim 4, wherein the digest level segment 
information 

5 structures can be arranged with the order of their time range information in order 
to construct a digest stream from multi level digest segment information scheme 
fast 



9. A method of generating multiple levels of digest streams for 
10 multimedia contents in accordance with the present invention comprising the steps 
of; 

detecting the digest level and time range information of the digest segment 
information structures from the multiple level digest stream information scheme 
contained in the content-based data area of the multimedia stream; and/or 

15 detecting the additional information about each digest segment information 

structure such as occurrence of events, appearance of persons, ubjects, 
backgrounds, and situation information of events, persons, objects, backgrounds 
contained in the content-based data area of the multimedia stream; and 

when a condition is queried by the user, generating a multiple level digest 

20 stream by arranging the digest segments with a priority of more than a certain 
level corresponding to the condition in a time sequence. 



10. The method of claim 
information or a digest stream running 
25 matched level of digest stream with a 



9, wherein a digest level running time 
time information can be used to find the 
user's input fast where the digest level 
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running time information is Information about the sum of running time of digest 
segment information structures of the same digest level is described according to 
digest levels, and the running time information of the digest stream is a running 
time information of a possible digest streams. 

5 

11. The method of claim 10, wherein a parity check is performed by 
comparing the total running time of the plurality of digest segments of the same 
digest level with the digest level running time of that digest level. 

10 12. The method of claim 10, wherein a parity check is performed by 

comparing the total running time of digest segment information structures having a 
digest level less than or equal to a particular level among the plurality of digest 
segments with the digest stream running time of that digest level. 

15 13. An apparatus for generating a multiple level digest stream of a 

multimedia steam comprising; 
a user input unit; 

a digest stream level determining unit for determining and outputting a 
digest level of a digest stream corresponding to a condition queried by the user 
20 input unit, upon receipt of a multimedia stream signal; and 

a decoder for decoding digest segments of the above digest level from the 
multimedia stream signal. 



14. The method of claim 11, wherein the condition is the running time 
25 of a digest stream. 
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15. The method of ciaim 13, wherein the condition is one of a time 
constraint of digest stream, a level information of digest stream, an occurrence of 
an event, an appearance of a person, a background, an object, situation 
information about of event, person, object, background. 

16. The method of ciaim 13, wherein the condition is combination of a 
time constraint of digest stream, a level information of digest stream, occurrence of 
events, appearance of persons, backgrounds, objects, situation information about 
of events, persons, objects, backgrounds. 

17. The method of claim 13, wherein a digest' level information and a 
time range information, and/or the information of the sum of the running time of 
each digest segment are contained in the digest level. 

18. The method of claim 17, wherein the time range information the 
start point and end point or the start point and duration of the digest segment. 

19. The method of ciaim 13, wherein the digest stream level 
determining unit comprises: 

a multiple level digest segment information scheme analyzing unit for 
computing the running time of each digest stream, by analyzing a multiple level 
digest segment information scheme contained in the content-based data of the 
multimedia stream signal; and 

a digest stream information display unit for selecting and querying a running 
time of a plurality of running times by the user, by displaying the running times by 

22 



computed digest stream. 



20. The method of claim 13, wherein the digest stream level 
determining unit comprises: 

5 a multiple level digest segment information scheme analyzing unit for 

computing the running time of each digest stream, by analyzing a multiple level 
digest segment information scheme contained in the content-based data of the 
multimedia stream signal; and 

a digest level determining unit for outputting a digest level of a digest 

LO stream corresponding to a running time most close to the queried running time, 
upon receipt of the above running time. 

21 . The method of claim 20, wherein the digest level determining unit 
compares the running time queried by the user with the running time and/or 

15 additional information such as occurrence of events, appearance of persons, 
backgrounds, objects, situation information about of events, persons, objects, 
backgrounds of digest stream and digest segment information structures, selects a 
running time most close to the queried running time, and outputs a digest :evel of 
the digest stream with the selected running time and/or additional information such 

20 as occurrence of events, appearance of persons, backgrounds, objects, situation 
information about of events, persons, objects to the decoder. 
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ABSTRACT OF THE DISCLOSURE 

The present invention is intended to provide multiple levels of digest 
streams for multimedia contents with small amount of additional storage using a 

5 multiple level digest segment information scheme. In the present invention, a 
multiple level digest segment information is contained in the content-based data 
area of the multimedia content by representing a level information of each digest 
segment by multiple levels in a content-based data area of a multimedia content, 
describing the digest level of the digest segment and the time range information of 

10 the digest segment in the digest segment information scheme, and outputting 
digest segments whose digest level is less than or equal to requested digest level 
by decoding, upon receipt of the digest level of the digest segment. 
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